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Memo 10 

THE LISP DIFFERENTIATION DEMONSTRATION PROGRAM 

by K. Haling 

1. Introduction 
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This program Is a byproduct of the machine language wnich 
Is being developed for the Artificial Intelligence pro^ecs. It 
was written because the process of differentiation and to some 
extent that of simplification* turned out to be very conveni¬ 
ently expressable in LISP. There are two main reasons for 
this: one is the fact that algebraic expressions are most 
easily represented in a computer by means of a list language 
and the other is the ability of LISP to describe recursive 
processes. 

The program is internally in ; two distinct parts. The 
first is the differentiation program* which is written out 
for the case of PLUS and TIMES (The only differentiable 
functions that db not have a fixed number of arguments) and 
which handles all other functions by making substitutions of 
their arguments into the gradient. It is up to the user to 
add thb gradients of functions which he wishes to differenti¬ 
ate . It will normally take one card per function and there 
is no restriction on the number of functions ov their order. 

When the differentiation program was first tested out 
it was found that the resulting expressions ’were usually 
enormous and contained a large number of redundant symbols» 

The second part therefore consists of a simplification program. 
which Is written out for PLUS andjTIMES* the chief offenders* 
and for all other functions the recognition of degenerate 
cases is built it. Again it is up to the user to add the 
degenerate cases and their equivalents for the functions in 
which he 13 interested* and again 1 there are no restrictions 
on their number or order. 

There is one further feature!which Involves the Universal 
LISP Function "Apply”. Apply is in effect an interpreter which 
causes any process defined in LISP to be performed on an 
expression. The user mag'’ have his own list processes carried 
out in two places* (a) during the i simplify program* -whenever 
any function appears which he has;introduced (any one LISP 
program will be for one function only,* but each function may 
have such a urogram), (h) after the above ninvlifi”Cti ~r 
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n?x further manipulation; 
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For instance. we write 
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(TIMES.;:, (PLUS.u.l), (SIH.y)} 

0} as (cons. {car .:>•:}, INTV,0)) 
similar form. An infix reader and printer are 
ad may be added at a later date. At the moment 
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only -literals and digits are legal characters and the names of 
functions li!:e RATIO and MINUS must be written as words. Numbers 
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.et-ly lilce symbols and "simplify" dees no arithmetic 
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The user is cautioned against 


a common source of error, namely the failure to provide a suf¬ 
ficient numbor of right parentheses• 
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3„1 For the following sections familiarity with the basic LISP 
functions ana the method of writing program functions is assumed 
Let L be the list representation of an algebraic expression 
Let v be the variable-with respect to which it is being dif 
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Liff(L-V;^/L"‘V—?i, atom^L)—■*0, car(jL») ** PLUS—^cons{PLUS,maulis 
{c a r {L) , \ {J , d if f {c ar (J) , V)}}), c ar (L) «TIHES—>cons {PLUS , taapli s 

(edr(L).>.{J,cons{TIMES,maplis{cdr(L),7v(K, J>&-»car(K),T- 5 

cliff {car (K) ,V))))})) - T—->cons {PLUS, map2 (sublis (pair {car (gradnt 
(car (1.)} 5 s car {L)}, cadr (gradnt (car (L)) )),cdr{L),MJ,K, 
li3t-(Ti:iSS,copy{car( J)),diff (car{K),V)))))/ 

Grudnt(II}-- sear ch{M,A ( J,car { j)-gradl ) , ?i(J, cadr (J)) ,print comment) 

<,2 The case of functions other than PLUS and TIKES is not 
easily understood from reading this definition, and an example is 
therefore given. d{u/v)/dx 

A*} 

d(u/v}cix *« l/vo {dx/ds) t- (-u/v ) *(dv/dx) 

The gradient of (RATIO,u,v) is therefore (l/v,(-u/v 2 )) 

The folicwing expression is added to the property list of RATIO. 

(GRAD!,{(u,v),{(RATIO,l,v),(RATIO, (MINUS,0,u),(TIMES,V,v) )))) 
Suppose that (RATIO, l,x) is being differentiated. 
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S sdnt(c"r(L}} - gr adnt(RATIO}^{ (u,v),((RATIO,l,v),(RATIO, 

(■■;:«::d;^,o,u), (times, v,v)))) ~ g. 

Then pair(ear{G), cdr(L) )—>( (u,l),(v,x)) >* H 

and cadr;gradnt(car{L) ))—*{(RATIO*l,v),(RATIO, (MINUS,0,u) f 

(TIMES,v,v)} )--I 

lienee su.dis ^H,ij~ ( EATIO,l,x),(RATIO,(MINUS,0,1-(TIMES,x,x))) *M 

so that r,:ap2(M,cdr(L), A(J.K. lis t( TIKES, copy{car(J) ),diff (car 
(K) ,V 5 )) MK (TIKES, (RATI0*l,x),0),(TIMES, (RATIO, (MINUS,0,1) 
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anct when preceded by a PLUS this is the required result, though 
In some need of simplification, 

3*3 It will be noted that MINUS is treated as a binary operator, 

• ‘ , • 

an arbitrary decision that wasjprompted by a wish to treat PLUS 
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and Minus as similarly as possible to TIMES and RATIO-, - . 

Since d{u-v)/dx « du/dx - dv/dx 

One writes the gradient of MINUS as (1, (MINUS,0, l)) 
so that on the property list of MINUS should appear 
(GRADl,((u,v), (1, (MINUS, 0,1))) ) 

However if a unary minus ’were used, one would put on the property 


(GRADX,{ (u,v). 
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(GRADl,((.u),((MINUS,l)))) ! 

Simplification 

Sums and products are simplified in the following ways. 

1> Products that contain a zero term are replaced by zero, 

l 

2„ Zero terras in sums or unit terms in products are deleted. 

3. Sums of sums are combined to contain only one PLUS and 
products of products are combined to contain only one TIMES. 

4. A sum of no terms is zero, a product of no terms is one. 

5. A sura or products of only one term is the term itself. 

Let L be a well-formed algebraic expression in LISP. 

Simplify (L) «/atom(L)—9return(L), 

K^maplis(car(L),A(J,simplify(car(J)))) 

j 

car{L)^PLUS- 9 go(al) ! v ■ 

Kl-mapccn (K, 1\ { J, car (j)**0 —f A s caar (J)**PLUS—*cdar ( J) ,T—s>cons 

(car(J },A))) 1 

| • 

null {K1 )-^r e turn (0) 
null(cdr(Kl))—>return(car(Kl)) 

T—>re turn (cons (PLUS, Kl)) ! 
car {L) /TIMES—->go (a2) 
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T—>s oar* c h {K a (j * car (J} <*0) , re turn (0) ,go(a3) ) 

{a3) K3.-*-inapcon {K, A (J, car (j) **1—caar {J)»TIMES—^edar (J), T —> 

eons (car {J) ,/\ )))' 

■ n-ai3.(Kl5“-->rGturn{l) 

null(cdr(Kl)}—^return {ear (:K1)} 

T—>>ra turn {cons { TIDIES ,K1)) 

(a2) 11-3earch{car {L). p car ( J)«SPSC 1) 9 A (J, cadr (J)) s go{a4) ) 

r e turn {searc h {M, ft (J , ins t (c adaor c aar (<Tj,K),ft( J, sublis (ins t { cadar 

{J} ,caar(j),K),caddr(J)),L)) 

(a4} re turn{search(car(L)ft(J,car(J)“SPEC2,ft( J,apply(cadadr 

(j),L,caadr(j))),L) 

4.2 Examples will again be given to clarify the method whereby 
degenerate cases are recognized, and whereby the user can introduce 
his own program* 

Suppose (RATI0,x,x) is to be replaced by "1" and (RATIO,x,l) 
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Many other cases such as 0/y, x/0, x/(y/z), could of course be 
added, 

he add to the property lisjfc of RATIO 
(SPEC1, { ( (u,u) , ((u), (v)) ,1) , ((u,v) , ((u), (v,l)) ,u))) 

M of (a2) above will be cadr of this expression* 

Where L is (RATI0,Xjx) . • 

inst( ((u), (v)'), (u,u3,(x,x))—=?((u>x)} ; • . 

and sublis ({(u,x-)) s l)—?1. ’ 

Where. L is (RATI0,x,l) : " 

inst( {(x),(v,2)), (u,v), (u,v), (x.,1))—${(u,x),(v,l)) 

3 sublis (((u,x),(v,1)) 

• • • 

example with "Apply" will be provided later. 
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Input Statements 
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The imperatives which the program can obey are 
(DIFFERENTIATE,■ { S IN, X ) , X ) 

which means, differentiate sin(x) with respect to x. 

( SIMPLIFY* (PLUS,Y, 0) ) 

The meaning is obvious. ■ 

STOP . causes the computer to halt. 

* 

To add gradients, degenerate cases or LISP program to the 
property list of a function, one must write 
(FUNCTION, SIN) (GRAD1,((U),((C0S,V)))) or 

FUNCTION,LOG) (SPECl,(((U),((U,l)),0)) 
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it is very important to spoil the following words correctly^ 

DIFFERENTIATE* SIMPLIFY, FUNCTION, PLUS,, TIMES, STOP, GRAD1, 
SPECl, SPEC2. 

it is also essential to have the correct depth of paren- 
theses, and to include matching right hand parentheses* 
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cgram Print-out 




The demonstration will always begin with 
"THIS IS A DEMONSTRATION OF SYMBOLIC DIFFERENTIATION USING 
LISP, A LIST PROCESSING LANGUAGE. THE CARD CONTAINING THE 
EXPRESSION TO BE DIFFERENTIATED, AND THE GRADIENTS OF ALL 
THE FUNCTIONS USED IN IT, SHOULD FOLLOW THE DECK WHICH HAS 
JUST BEEN READ IN. 

NON PRESS THE START KEY* 

A card reacting (DIFFERENTIATE,(B),x) causes the print-out 


IS NOW BEING DIFFERENTIATED WITH RESPECT TO 


The result is presented by 


THE DERIVATIVE IS 
/ 


A card reading 


(SIMPLIFY, (Ej_)) causes the print out 


( S l) 

CAN BE SIMPLIFIED TO ' 

( ^2 ) 

A card reading (FUNCTIONS) (GRAD1, (E)) causes the print out 
G 

HAS NOW ON ITS PROPERTY LIST ; 

(GRADI,(E}} 

If the program is called upon to differentiate a function 
without having previously been provided with the gradient, then 
the program will print out: 

THE PROGRAM HAS NOT BEEN GIVEN THE GRADIENT OF 


PUT A CARD ON WHICH ITS GRADIENT IS PUNCHED IN THE CARD READER 

AND PRESS THE START KEY*- 

If the program Is given an expression which is not of the types 
described in section 5, It will print. 


IS NOT AN ACCEPTABLE EXPRESSION. TRY AGAIN. 

If the program attempts to read when there are no more cards in 
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the card reader, either because the user has pressed the start 
key af.'c-tr a machine halt or because the program has Just read 

an expression of the form (FUNCTIONS) then the program will 

! 

orint« i 
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THERE IS NO CARD FOR THE READER TO READ. TRY AGAIN. 

7 e ' Checking Out Expressions < 

It was mentioned in Section 1 that the user can add any 
LISP program of his own,, which will foe executed after the 
simplify program described in Section 4 has been executed, 
and will use as its argument the result of such previous 
simplification. The intention of this facility is to make 
possible cancellation, counting, small Integer arithmetic and 
infix printing, for example. 

The user is referred to the LISP programmers Manual for 
information on checking out programs for Apply. This LISP 
program can then be added to the demonstration program by 

writing 

(FUNCTION, SIMPLIFY) (SPEC2,((A),(P))) 

Both SIMPLIFY ana DIFFERENTIATE (unslmplifled) are available to 
Apply as subroutines. The purpose of the Imperative 
(SIMPLIFY^) 

is of course to make easy the checking out SPEC1 and SPEC2 
type additions'to the property list of functions. Note,that 
nothing added to the property lists of PLUS and TIMES will 
affect the program in any way.; 

The authors of this program accept no responsibility for 
any results produced by it, right or wrong, and do not wish to 
answer any questions about it.; 
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